147 research outputs found

    Temporal Dynamic Quantization for Diffusion Models

    Full text link
    The diffusion model has gained popularity in vision applications due to its remarkable generative performance and versatility. However, high storage and computation demands, resulting from the model size and iterative generation, hinder its use on mobile devices. Existing quantization techniques struggle to maintain performance even in 8-bit precision due to the diffusion model's unique property of temporal variation in activation. We introduce a novel quantization method that dynamically adjusts the quantization interval based on time step information, significantly improving output quality. Unlike conventional dynamic quantization techniques, our approach has no computational overhead during inference and is compatible with both post-training quantization (PTQ) and quantization-aware training (QAT). Our extensive experiments demonstrate substantial improvements in output quality with the quantized diffusion model across various datasets

    Harnessing AI for Speech Reconstruction using Multi-view Silent Video Feed

    Full text link
    Speechreading or lipreading is the technique of understanding and getting phonetic features from a speaker's visual features such as movement of lips, face, teeth and tongue. It has a wide range of multimedia applications such as in surveillance, Internet telephony, and as an aid to a person with hearing impairments. However, most of the work in speechreading has been limited to text generation from silent videos. Recently, research has started venturing into generating (audio) speech from silent video sequences but there have been no developments thus far in dealing with divergent views and poses of a speaker. Thus although, we have multiple camera feeds for the speech of a user, but we have failed in using these multiple video feeds for dealing with the different poses. To this end, this paper presents the world's first ever multi-view speech reading and reconstruction system. This work encompasses the boundaries of multimedia research by putting forth a model which leverages silent video feeds from multiple cameras recording the same subject to generate intelligent speech for a speaker. Initial results confirm the usefulness of exploiting multiple camera views in building an efficient speech reading and reconstruction system. It further shows the optimal placement of cameras which would lead to the maximum intelligibility of speech. Next, it lays out various innovative applications for the proposed system focusing on its potential prodigious impact in not just security arena but in many other multimedia analytics problems.Comment: 2018 ACM Multimedia Conference (MM '18), October 22--26, 2018, Seoul, Republic of Kore

    Case report: Three-dimensionally printed patient-specific acetabular cage for revision surgery of aseptic loosening in a dog with micro total hip replacement.

    Get PDF
    A 2-year-old castrated male Pomeranian dog was presented for regular follow-up after micro total hip replacement (mTHR) 16 months prior to presentation. Clinically, the dog did not show any noticeable lameness of the left hindlimb, except for external rotation during walking. However, radiographic findings, namely rotation and medialization of the acetabular cup with a periprosthetic lucent line and bone formation medial to the acetabulum, were interpreted as aseptic loosening of the acetabular component. Because the dog was incompatible with the conventional THR revision method owing to severe bone defects in the acetabulum, a patient-specific titanium acetabular cage prosthesis with biflanges and four cranial and one caudal screw hole was designed for revision surgery. A custom-made acetabular cage was prepared, and it had a 12-mm polyethylene cup fixed with polymethylmethacrylate bone cement and positioned in the acetabulum. After the custom-made acetabular cage was anchored to the pelvic bone with the five cortical screws, reduction of the prostheses was achieved smoothly. The dog showed almost normal limb function without external rotation of the left hindlimb 2 weeks postoperatively. Bone remodeling and stable implant position were noted on radiographic images 3 years after revision surgery, with no evidence of loosening. Based on the clinical outcomes, the use of a custom-made acetabular prosthesis can be an effective treatment option for revision arthroplasty in acetabula with severe bone loss and structural changes in small-breed dogs

    Structure of AGCM-Simulated Convectively Coupled Kelvin Waves and Sensitivity to Convective Parameterization

    Get PDF
    A study of the convectively coupled Kelvin wave (CCKW) properties from a series of atmospheric general circulation model experiments over observed sea surface temperatures is presented. The simulations are performed with two different convection schemes (a mass flux scheme and a moisture convergence scheme) using a range of convective triggers, which inhibit convection in different ways. Increasing the strength of the convective trigger leads to significantly slower and more intense CCKW activity in both convection schemes. With the most stringent trigger in the mass flux scheme, the waves have realistic speed and variance and also exhibit clear shallow-to-deep-to-stratiform phase tilts in the vertical, as in observations. While adding a moisture trigger results in vertical phase tilts in the mass flux scheme, the moisture convergence scheme CCKWs show no such phase tilts even with a stringent convective trigger. The changes in phase speed in the simulations are interpreted using the concept of "gross moist stability" (GMS). Inhibition of convection results in a more unstable tropical atmosphere in the time mean, and convection is shallower on average as well. Both of these effects lead to a smaller GMS, which leads to slower propagation of the waves, as expected from theoretical studies. Effects such as changes in radiative heating, atmospheric humidity, and vertical velocity following the wave have a relatively small effect on the GMS as compared with the time mean state determined by the convection scheme.open222

    Case report: Primary chronic calcaneal bursitis treated with subtotal bursectomy in a cat.

    Get PDF
    A 6-year-old, female spayed Bengal cat with a bodyweight of 6.4 kg was presented with swelling of the bilateral calcaneal region and weight-bearing hindlimb lameness with a 4-month history of unsuccessful conservative therapy. On orthopedic examination, a cyst-like mass around the calcaneal tendon was palpated. Palpating the mass and flexing the tarsal joint triggered pain. Through ultrasonography and magnetic resonance imaging, an inflamed or fluid-accumulated lesion was suspected around the calcaneal tendon, but there was no evidence of calcaneal tendonitis. Swollen calcaneal bursae were removed surgically. Histopathologic examination revealed fibrosis and an edematous feature. The cat was diagnosed with bilateral chronic primary calcaneal bursitis based on history, clinical signs, and diagnostic results. Hence, subtotal bursectomy was performed. At 4 weeks postoperatively, the cat had no pain around the tarsal joints and was ambulating normally. Radiographic and ultrasonographic exams revealed no recurrence of swelling or inflammation in the calcaneal region. Thirteen-month follow-up confirmed acceptable function and no relapse of clinical signs. The inflammation of calcaneal bursa alone can be the primary cause of hindlimb lameness in cats. A cat with hindlimb lameness and swelling on the calcaneal region should be assessed with the possibility of primary calcaneal bursitis. Subtotal calcaneal bursectomy can be considered as an effective treatment for primary chronic bursitis

    The ancient phosphatidylinositol 3-kinase signaling system is a master regulator of energy and carbon metabolism in algae

    Get PDF
    Algae undergo a complete metabolic transformation under stress by arresting cell growth, inducing autophagy and hyperaccumulating biofuel precursors such as triacylglycerols and starch. However, the regulatory mechanisms behind this stress-induced transformation are still unclear. Here, we use biochemical, mutational, and “omics” approaches to demonstrate that PI3K signaling mediates the homeostasis of energy molecules and influences carbon metabolism in algae. In Chlamydomonas reinhardtii, the inhibition and knockdown (KD) of algal class III PI3K led to significantly decreased cell growth, altered cell morphology, and higher lipid and starch contents. Lipid profiling of wild-type and PI3K KD lines showed significantly reduced membrane lipid breakdown under nitrogen starvation (-N) in the KD. RNA-seq and network analyses showed that under -N conditions, the KD line carried out lipogenesis rather than lipid hydrolysis by initiating de novo fatty acid biosynthesis, which was supported by tricarboxylic acid cycle down-regulation and via acetyl-CoA synthesis from glycolysis. Remarkably, autophagic responses did not have primacy over inositide signaling in algae, unlike in mammals and vascular plants. The mutant displayed a fundamental shift in intracellular energy flux, analogous to that in tumor cells. The high free fatty acid levels and reduced mitochondrial ATP generation led to decreased cell viability. These results indicate that the PI3K signal transduction pathway is the metabolic gatekeeper restraining biofuel yields, thus maintaining fitness and viability under stress in algae. This study demonstrates the existence of homeostasis between starch and lipid synthesis controlled by lipid signaling in algae and expands our understanding of such processes, with biotechnological and evolutionary implications.Ministry of Science, ICT and Future Planning 2015M3A6A2065697Ministry of Oceans and Fisheries 2015018
    corecore